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for image files 



CM 
< 

5> 



CL 
LU 



(57) A CPU of a color printer performs gamma cor- 
rection and a matrix operation M on an RGB color space 
image data derived by a matrix operation S. Using gam- 
ma correction value settings, the CPU performs gamma 
conversion of image data. Matrix operation M converts 
the RGB color space to an XYZ color space. When per- 
forming matrix operation M, the CPU refers to a Print- 
Matching tag and performs the matrix operation using a 
matrix (M) that corresponds to the indicated color space, 
in order to reflect the color space used for generation of 
image data. 
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Description 

BACKGROUND OF THE INVENTION 
Field of the Invention 

[0001] The present invention relates to apparatuses, 
methods and computer program product that involve 
color space conversion processing on image data. More 
particularly, the present invention relates to apparatus- 
es, methods and computer program product used in, 
and by, devices such as digital still cameras (DSC), dig- 
ital video cameras (DVC), scanners, which capture and 
store images in a first color space, with a recognition 
that a color space conversion operation will be per- 
formed in downstream processing. The invention also 
relates to the apparatuses, methods and computer pro- 
gram product that perform the downstream processing, 
perhaps in the output device, such as a printer or dis- 
play. Thus, the invention also relates to signal process- 
ing hardware and software components, including prop- 
agated data signals, and presentation devices, such as 
printers. 

Discussion of the Background 

[0002] In recent years there has been growing de- 
mand for DSCs, DVCs, scanners, and other devices that 
handle digital photographic or scanned images in the 
form of easily manipulated image files. In DSCs and sim- 
ilar devices, digital photographic image data is typically 
stored in JPEG format files, one of the formats used for 
compressed image files. In JPEG files, image data is 
defined using a YCbCr color space so as to enable a 
high compression ratio. Accordingly, devices such as 
DSCs translate photographic image data represented in 
an RGB color space to a YCbCr color space. The RGB 
color space used by devices such as DSCs is typically 
a standard color space for personal computer C RT mon- 
itors (e.g., sRGB: IEC61 966 2-1 ). 
[0003] Since personal computers use an RGB color 
space as the standard color space for image data, a per- 
sonal computer receiving a JPEG file must decompress 
the JPEG file and convert the color space of the image 
data from a YCbCr color space to an RGB color space. 
Image data that has been converted to an RGB color 
space is either displayed on a monitor, or is converted 
to a CMYK color space for print output on a print medium 
via a printer. 

[0004] Conventional image processing by personal 
computers is typically based on an assumption that im- 
ages will be output on a CRT monitor, so the color space 
of image data that has been converted from a YCbCr 
color space to an RGB color space is typically "clipped" 
during conversion to the sRGB color space, which has 
color space characteristics adapted to display on CRT 
monitors, and is standard across personal computers. 
[0005] Thus, when a JPEG file generated by an image 



data generating device such as a DSC is decompressed 
and converted from a YCbCr color space to an RGB 
color space by a personal computer, color values out- 
side the gamut of the sRGB color space are inevitably 

5 rounded, even in cases where the gamut of the RGB 
color space of the image data exceeds the gamut of the 
sRGB color space. In such cases, colors that exceed 
the gamut of the sRGB color space are not reflected in 
the output image. As a result, the full color reproduction 

10 capabilities of an output device is not utilized-even 
where the reproducible color range of the output device 
exceeds that of the sRGB color space. Another draw- 
back is a failure to effectively utilize the full color repro- 
duction capabilities of DSCs. 

15 [0006] The sRGB color space, which is matched to 
the color reproduction capabilities of monitors, has been 
widely adopted as the standard RGB color space, and 
conventional YCbCr-to-RGB color space conversion 
currently relies on conversion matrices that have been 

20 designed on the assumption that images will be dis- 
played on a monitor. Thus, even if one were to define a 
new RGB color space having a wider gamut than the 
sRGB color space, unless one also adopted the new 
RGB color space as the color space used by all the de- 

25 vices-from the input device to the output device--for im- 
age processing, the lack of a common standard would 
result in an inability to easy modify color space at- 
tributes. 

[0007] Some image file users overcome this problem 
30 by performing image file image adjustment using image 
file correction software that gives output accurately re- 
flecting the native color space of a DSC or other device. 
However, such image adjustment is rather complicated. 
[0008] With the foregoing in view, it is an object of the 
35 present invention to provide an image output device ca- 
pable of accurately outputting information indicating the 
color space used when image data is generated. It is a 
further object to provide an image output device capable 
of effectively utilizing the color reproduction range of a 
40 device that generates image data, or of a device that 
outputs image data. 

SUMMARY OF THE INVENTION 

45 [0009] It is an object of the present invention to solve 
the above-described and other problems associated 
with color space conversion processes. 
[0010] The present invention, in a first aspect thereof, 
addresses this problem and other problems by providing 
50 an image processing apparatus for performing image 
processing using an image file that includes image data 
and use information indicating whether out of gamut in- 
formation for a specific color space is used. The image 
processing apparatus according to this first aspect in- 
55 eludes image file acquisition mechanism for acquiring 
the image file; decision mechanism for deciding, on the 
basis of use information contained in the acquired file, 
whether to use information out of gamut for a specific 
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color space; and image processing mechanism that, if 
decided to use the out of gamut information, performs 
image processing of the image data, that includes color 
conversation to a wide color space having a wide gamut 
that accommodates the out of gamut information within 
the gamut thereof. 

[0011] According to the image processing apparatus 
of this first aspect, in the event that out of gamut infor- 
mation for a specific color space is used, image process- 
ing that includes color conversation to a wide color 
space having a wide gamut that accommodates the out 
of gamut information within the gamut thereof is per- 
formed, whereby color values include in image data at 
generation of the image data may be utilized for correct 
reproduction of the image data. 

[0012] According to the image processing apparatus 
of this first aspect, in the event that it is decided not to 
use the out of gamut information, the image processing 
apparatus may perform image processing of the image 
data via a predetermined color space having a gamut 
equivalent to the specific color space. With this arrange- 
ment, image processing can be carried out using pre- 
determined information in the event that it decided not 
to use out of gamut information. 
[0013] According to the image processing apparatus 
of this first aspect, the image data contained in the im- 
age file is defined by a first color space; the image file 
acquisition mechanism converts the color space of the 
image data contained in the acquired image file from the 
first color space to a second color space; and the image 
processing mechanism converts the color space of the 
image data defined by the second color space to a third 
color space using the out of gamut values. 
[0014] With this arrangement, during conversion of 
image data defined by a second color space to a third 
color space, out of gamut values are used for the color 
space conversion, whereby image data may be accu- 
rately reproduced using color values contained in image 
data at generation of the image data. 
[0015] According to the image processing apparatus 
of this first aspect, the first color space is a YCbCr color 
space, the second color space is a first RGB color 
space, and the third color space is a second RGB color 
space having a wider gamut than the second color 
space. The second RGB color space may be the sRGB 
color space. The third color space may be the CIELAB 
color space rather than a second RGB color space. 
[0016] With this arrangement, an image is output us- 
ing image datathat has asecond RGB color space wider 
than the first RGB color space, whereby it is possible to 
output an image of higher saturation than is the case 
where image data having the first RGB color space is 
used. Where the color space of the output data is the 
CIELAB color space, color matching is facilitated, thus 
providing an advantage when image processing is per- 
formed in yet another device. 

[0017] According to the image processing apparatus 
of this first aspect, the image data contained in the im- 



age file is represented by a first color space and includes 
first positive color values lying within the gamut of the 
specific color space, and/or second positive color values 
and negative color values lying outside the gamut of the 

5 specific color space; and 

the image file acquisition mechanism uses the first 
and second positive color values and the negative color 
values to convert the color space of the image data from 
the first color space to a second color space. With this 

10 arrangement, image processing can be performed so 
as to reflect first and second positive color values and 
negative color values in the image data, thereby improv- 
ing reproduction of the image data in an output device. 
[0018] According to the image processing apparatus 

15 of this first aspect, the image processing mechanism in- 
cludes a gamma correction mechanism for performing 
gamma correction of the image data using a first gamma 
correction value in the event that the image data con- 
tains the first and second positive color values, and us- 

20 ing a second gamma correction value that differs from 
the first gamma correction value, in the event that the 
image data contains negative color values. With this ar- 
rangement, appropriate gamma correction can be per- 
formed when image data includes positive color values, 

25 or includes negative color values. 

[0019] According to the image processing apparatus 
of this first aspect, the second gamma correction value 
may be smaller than the first gamma correction value. 
This allows negative color values to be utilized effective- 

30 |y to further expand the range of color reproduction of 
image data. 

[0020] According to the image processing apparatus 
of this first aspect, the image processing mechanism 
converts the image data, represented by the second 

35 color space and including the first positive color values, 
the second positive color values and the negative color 
values, to a third color space that is wider than the sec- 
ond color space and whose gamut includes the second 
positive color values and/or the negative color values. 

40 This allows second positive color values and/or negative 
color values that cannot be represented in the second 
color space to be included in the gamut of the third color 
space, so that second positive color values and/or neg- 
ative color values may be reproduced for output. This 

45 improves saturation in image data, and affords effective 
utilization of the color reproduction range of the device 
generating the image data or the device outputting the 
image data. 

[0021] According to the image processing apparatus 
50 of this first aspect, the first color space is an RGB color 
space represented by a R component, a G component, 
and a B component, and the second gamma correction 
value includes a second gamma correction value for the 
R component, a second gamma correction value for the 
55 g component, and a second gamma correction value 
for the B component, the values being mutually different. 
With this arrangement, gamma correction optimized for 
respective representation by the R component, G com- 
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ponent, and B component can be performed on image 
data including negative color values. 
[0022] According to the image processing apparatus 
of this first aspect, conversion of the color space of the 
image data from the first color space to the second color 
space by the image file acquisition mechanism is per- 
formed by way of a first matrix operation performed on 
image data represented by the first color space, and 
conversion of the color space of the image data from the 
second color space to the third color space by the image 
processing mechanism is performed by way of a second 
matrix operation performed on image data represented 
by the second color space. 

[0023] In a second aspect, the invention provides an 
image processing apparatus for performing image 
processing with image data that is represented by a first 
color space and that includes first positive color values 
lying within the color gamut of a specific color space, 
and/or second positive color values and negative color 
values lying outside the color gamut of the specific color 
space. The image processing apparatus pertaining to 
this second aspect of the invention includes an image 
data acquisition mechanism for acquiring the image da- 
ta; and a color space conversion mechanism for using 
the first and second positive color values and negative 
color values to convert the color space of the image data 
from the first color space to a second color space that 
is wider than the specific color space and that includes 
the second positive color values and/or negative color 
values in the gamut thereof. 

[0024] According to the image processing apparatus 
of this second aspect, an image data color space is con- 
verted, using first and second positive color values and 
negative color values, to a second color space whose 
gamut includes these second positive color values and/ 
or negative color values, whereby color values con- 
tained in image data when generated can be utilized for 
accurate reproduction of the image data. 
[0025] Like the image processing apparatus pertain- 
ing to the first aspect, the image processing apparatus 
pertaining to this second aspect may be reduced to 
practice in a number of other embodiments. 
[0026] The image processing apparatus pertaining to 
the first or second aspect may further include a printing 
mechanism for printing the image processed image data 
onto a print medium. This enables output of image proc- 
essed image data. 

[0027] In a third aspect, the invention provides a pro- 
gram for outputting, by way of an image output device, 
image data using an image file that contains image data 
and use information indicating whether out of gamut 
color values for a specific color space are used. The pro- 
gram pertaining to this third aspect executes, by way of 
a computer, a function for acquiring the image file; a 
function for deciding, on the basis of the use information 
contained in the acquired image file, whether to use 
color values that are out of gamut of the specific color 
space; a function whereby, in the event that it is decided 



to use the out of gamut color values, image processing 
of the image data is performed via a color space having 
a wide gamut that accommodates the out of gamut color 
values within the gamut thereof; and a function for out- 
5 putting the image processed image data. 

[0028] According to the program pertaining to this 
third aspect, there are afforded working effects analo- 
gous to those of the image processing apparatus of the 
first aspect. Like the image processing apparatus per- 
taining to the first aspect, the program pertaining to this 
third aspect may be reduced to practice in a number of 
different embodiments. 

[0029] In a fourth aspect, the invention provides a de- 
vice for generating an image file that contains image da- 
ta and image processing control information indicating 
image processing conditions for image data. The image 
file generating device pertaining to this fourth aspect in- 
cludes an image data acquisition mechanism for acquir- 
ing the image data; an image processing control infor- 
mation generation mechanism for generating the image 
processing control information, including use informa- 
tion that indicates whether out of gamut information for 
a specific color space is used for image processing of 
the image data; and an image file generation mecha- 
nism for generating an image file that contains the ac- 
quired image data and the generated image processing 
control information. 

[0030] According to the image file generating device 
pertaining to this fourth aspect, it is possible to generate 
an image file that includes acquired image data and im- 
age processing control information that includes use in- 
formation indicating whether out of gamut information 
for a specific color space is used, thereby enabling im- 
age processing of image data utilizing out of gamut in- 
formation. 

[0031] In a fifth aspect, the invention provides a de- 
vice for generating an image file that contains image da- 
ta and image processing control information indicating 
image processing conditions for image data. The image 
file generating device pertaining to this fifth aspect in- 
cludes an image data generation mechanism for gener- 
ating image data that includes first positive color values 
lying within the gamut of a specific color space, and/or 
second positive color values and negative color values 
lying outside the gamut of the specific color space; and 
an image processing control information generation 
mechanism for generating image processing control in- 
formation that includes use information indicating 
whether the second positive color values and/or nega- 
tive color values are used during image processing of 
the image data, a first gamma correction value for use 
where the image data contains the first and second pos- 
itive color values, and a second gamma correction val- 
ue, different from the first gamma correction value, for 
use where the image data contains negative color val- 
ues. 

[0032] According to the image file generating device 
pertaining to this fifth aspect, it is possible to generate 
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an image file containing acquired image data and use 
information indicating whether second positive color val- 
ues and/negative color values lying outside the gamut 
of a specific color space, enabling image processing of 
image data utilizing these second positive color values 
and/or negative color values. 

[0033] In the image file generating device pertaining 
to this fifth aspect, the image processing control infor- 
mation may further include color space conversion char- 
acteristics for performing color space conversion of the 
image data, for conversion thereof to a color space that 
is wider than the specific color space and that includes 
the second color values and/or the negative color values 
in the gamut thereof. 

[0034] In a sixth aspect, the invention provides a 
method for outputting image data using image data rep- 
resented by a first color space and use information in- 
dicating whether information out of the gamut of a spe- 
cific color space is used. The method pertaining to this 
sixth aspect includes the steps of acquiring the image 
data and converting the color space of the acquired im- 
age data from the first color space to the second color 
space; deciding from the use information whether the 
out of gamut information is used; in the event that it is 
decided to use the out of gamut information, using the 
out of gamut information to convert the color space of 
image data represented by the second color space to 
the third color space; and outputting the converted im- 
age data. 

[0035] The method pertaining to the sixth aspect of 
the invention affords working effects analogous to the 
image processing apparatus of the first aspect of the in- 
vention. Like the image processing apparatus of the first 
aspect of the invention, the method pertaining to the 
sixth aspect of the invention may be reduced to practice 
in a number of different embodiments. 
[0036] In a seventh aspect, the invention provides a 
method for outputting image data. The method pertain- 
ing to this seventh aspect includes the steps of acquiring 
the image data represented by a first color space and 
converting the color space of the acquired data from the 
first color space to a second color space; holding infor- 
mation relating to the second color space resulting from 
the conversion, and information out of gamut of the sec- 
ond color space; converting image data represented by 
the second color space to a third color space so as to 
reflect the held information; and outputting the convert- 
ed image data. 

[0037] The method pertaining to the seventh aspect 
of the invention affords working effects analogous to the 
image processing apparatus of the first aspect of the in- 
vention. Like the image processing apparatus of the first 
aspect of the invention, the method pertaining to the 
seventh aspect of the invention may be reduced to prac- 
tice in a number of different embodiments. 
[0038] In an eighth aspect, the invention provides an 
image processing method for image data. The image 
processing method pertaining to this eighth aspect in- 



cludes the steps of acquiring image data based on a first 
color space and converting the color space of the ac- 
quired image data from the first color space to the sec- 
ond color space; for the converted image data, holding 
5 in-gamut and out of gamut information of the second 
color space; and converting the color space of the image 
data represented by the second color space to a third 
color space having a wider gamut than the second color 
space so as to reflect the full content of the information 
held. 

[0039] The method pertaining to the eighth aspect of 
the invention affords working effects analogous to the 
image processing apparatus of the second aspect of the 
invention. Like the image processing apparatus of the 
second aspect of the invention, the method pertaining 
to the eighth aspect of the invention may be reduced to 
practice in a number of different embodiments. 
[0040] In a ninth aspect, the invention provides an im- 
age processing apparatus for performing image 
processing on image data. The image processing appa- 
ratus of the ninth aspect comprises means for acquiring 
the image data, wherein the image data contains out of 
gamut information for a predetermined color space, 
means for instructing use of the out of gamut information 
for said predetermined color space, and means for per- 
forming image processing on said image data, wherein 
the image processing includes means for performing 
color conversion of said out of gamut information to a 
wide gamut color space when use of the out of gamut 
information is instructed, wherein a gamut of the wide 
gamut color space is sufficiently large to accommodate 
the image data associated with the out of gamut infor- 
mation. 

[0041] According to the image processing apparatus 
of this ninth aspect, in the event that the use of out of 
gamut information for a specific color space is instruct- 
ed, image processing that includes color conversation 
to a wide color space having a wide gamut that accom- 
modates the out of gamut information within the gamut 
thereof is performed, whereby color values include in 
image data at generation of the image data may be uti- 
lized for correct reproduction of the image data. 
[0042] In the ninth aspect, wherein the means for per- 
forming color conversion performs image processing 
the image data via a pre-established color space having 
a gamut equivalent to that of the predetermined color 
space when use of the out of gamut information is not 
instructed. 

[0043] An image processing apparatus for performing 
image processing on image data may comprises means 
for acquiring an image data, and means for performing 
image processing on said image data with the out of 
gamut information for said predetermined color space 
contained in the image data. With this image apparatus, 
the image processing is performed with the out of gamut 
information for said predetermined color space. There- 
fore, a saturation of the image processed data is im- 
proved. 
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[0044] The image processing may include means for 
performing color conversion of said out of gamut infor- 
mation to a wide gamut color space, wherein a gamut 
of the wide gamut color space is sufficiently large to ac- 
commodate the image data associated with the out of 
gamut information. In this ninth aspect, the out of gamut 
information for said predetermined color space is repro- 
duced in the wide gamut color space, then a saturation 
of the image processed image data is improved. The out 
of gamut information for said predetermined color space 
may be negative color data values, a gamma correction 
value for the negative color data values and a gamma 
correction value for positive color data values may be 
different. In this arrangement, gamma corrections suit- 
able for a gradient of the positive color data values and 
for a gradient of the negative color data values are per- 
formed, respectively. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0045] 

Figure 1 is an illustrative diagram of an exemplary 
image data output system in which the image output 
device of the first embodiment may be implement- 
ed. 

Figure 2 is a block diagram showing a simplified ar- 
rangement for a digital still camera capable of gen- 
erating an image file (image data) for output by the 
image output device of the first embodiment. 
Figure 3 is an illustrative diagram showing the gen- 
eral internal structure of an image file GF stored in 
the Exif file format. 

Figure 4 is a block diagram showing the general ar- 
rangement of the color printer pertaining to the first 
embodiment. 

Figure 5 is an illustrative diagram showing the inter- 
nal arrangement of a control circuit of the color print- 
er. 

Figure 6 is a flow chart showing the processing rou- 
tine for the printing process of the color printer per- 
taining to the first embodiment. 
Figure 7 is a flow chart showing the flow of image 
processing in the color printer pertaining to the first 
embodiment. 

Figure 8 is an illustrative diagram showing a two- 
dimensional representation of color space gamuts, 
illustrating the significance of allowing image data 
in an extended area (EA) of an RGB color space. 
Figure 9 is an illustrative diagram showing an ex- 
emplary first gamma curve L1 corresponding to first 
gamma correction values y^ and second gamma 
curves L2r, L2g and L2b corresponding to second 
gamma correction values 72r, 72g, y2b, for use in 
gamma correction. 

Figure 10 is an illustrative diagram showing color 
space ranges for the visible area (VA), sRGB (SR), 
NTSC (NS), and wRGB (WR). 



Figure 11 is a flow chart depicting image processing 
in a color printer as a second embodiment. 
Figure 1 2 is a flow chart depicting image processing 
in a color printer as a third embodiment. 
5 Figures 1 3-1 5 are descriptions of mathematical ex- 

pressions used for describing conversion process- 
es performed as part of the present invention. 
Figure 16 is a flow chart depicting image processing 
in a personal computer in accordance with a fourth 
10 embodiment. 

DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

15 [0046] A more complete understanding of the present 
invention will be gained through the following descrip- 
tion of the embodiments in the order indicated below, 
making reference to the accompanying drawings. 

20 A. Arrangement of image data output system in- 
cluding image output device 

B. Arrangement of image output device 

C. Image processing in image output device 

D. Other embodiments 

25 

A. Arrangement of image data output system including 
image output device 

[0047] The following description of the arrangement 

30 of an image data output system in which the image 
processing apparatus of the first embodiment may be 
implemented makes reference to Figs. 1 and 2. Fig. 1 
is an illustrative diagram of an exemplary image data 
output system in which the image processing apparatus 

35 of the first embodiment may be implemented. Fig. 2 is 
a block diagram showing a simplified arrangement for a 
digital still camera capable of generating an image file 
(image data) for output by the image processing appa- 
ratus of the first embodiment. 

40 [0048] Image data output system 10 includes a digital 
still camera 1 2 serving as an input device for generating 
image files; and a color printer 20 serving as an output 
device for performing image processing of image files 
generated by digital still camera 12, and outputting the 

45 resultant images. Besides a printer 20, the output device 
could be a monitor 14 (e.g. an CRT display, LCD display 
etc.), a projector, or the like; however in the following 
description the output device is assumed to be a color 
printer 20. 

50 [0049] The DSC 1 2 may also include an I/O port, such 
as a USB, IEEE 1394 port, or a wireless port, such as 
IR or RF, (e.g., Bluetooth compatible). When a "wired" 
communication channel is used (CV), such acoaxial ca- 
ble, USB cable, or CAT 5 cable, for outputting the result- 

55 jng image file, the propagated data signal is sent over 
the channel as an electric signal. When transmitted over 
a wireless channel, the propagated data signal is sent 
as an electromagnetic signal. As a data structure format 
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for saving the image data (GD) in DSC 12, a JPEG for- 
mat is typical, but it is also possible to use other file for- 
mats such as TIFF, GIF, BMP, and RAW. 
[0050] Digital still camera 1 2 acquires images by way 
of imaging optical information with a digital device (e.g. 
a CCD or photomultiplier); as shown in Fig. 2 it includes 
an optical circuit 121 for gathering optical information; 
an image acquisition circuit 1 22 for controlling the digital 
device in order to acquire an image; an image process- 
ing circuit 1 23 for processing the acquired digital image; 
and a control circuit 124 for controlling the various cir- 
cuits. The digital still camera 12 stores the acquired im- 
age as digital data in a memory device, namely, a mem- 
ory card MC. Alternatively, the image data is stored in 
semiconductor memory installed in the DSC 12, and 
then transmitted via a communication channel to an out- 
put device, or an intermediate processing device (such 
as a PC) prior to being delivered to the output device 
(such as a printer). The format for storing image data in 
a digital still camera 1 2 is typically the JPEG format, but 
other storage formats could be employed, such as TIFF, 
GIF, BMP, or RAW format. The digital still camera 12 is 
provided with a Select/Set button 126 for selecting and 
setting various functions. 

[0051 ] Digital images generated by digital still camera 
12 are defined by an RGB color space. Most typically, 
the RGB color space will be the sRGB color space, but 
the NTSC-RGB color space, which has a wider gamut 
than the sRGB color space, may be selected as well. 
For storage on the memory card MC, data represented 
by the RGB color space is converted to a YCbCr color 
space, which has color space characteristics suited to 
the JPEG format, the format in which the data will be 
compressed and stored. To store image data in JPEG 
format, image data represented in an RGB color space 
is subjected to an inverse matrix operation with a matrix 
S, described later, to convert the image data color space 
from an RGB color space, e.g. the sRGB color space, 
to a YCbCr color space. During conversion from the 
sRGB color space to the YCbCr color space, color val- 
ues lying outside the gamut of the sRGB color space, 
namely, color data having negative values, are also al- 
lowed for conversion. This would not be the case if 
standard processing techniques were used because the 
negative values would simply be converted, thus loosing 
the inherent information contained in these negative val- 
ues. 

[0052] The digital still camera 1 2 employed in this im- 
age data output system 10 attaches image processing 
control information Gl to the image data in the image file 
stored in the memory card MC. To retain exchangeability 
of image files, the image file generated by digital still 
camera 12 typically has a file structure in accordance 
with the format specified for digital still camera image 
files (Exif). The Exif specification was developed by the 
Japan Electronics and Information Technologies Indus- 
tries Association (JEITA). 

[0053] The following description of general structure 



of an image file having a file format in accordance with 
the Exif file format makes reference to Fig. 3. Fig. 3 is 
an illustrative diagram showing the general internal 
structure of an image file GF stored in the Exif file format. 
5 The terms "file structure ," "data structure," and "storage 
area" in this working example mean a file or data field 
configured to hold a digital representation of an image 
when a file or data, etc. is stored within a certain storage 
range of a storage device. 
w [0054] The Exif file, i.e. image file GF, contains a 
JPEG image data storage area 101 for storing image 
data in JPEG format, and an extra data storage area 
1 02 for storing extra data of various kinds relating to the 
stored JPEG image data. The extra data storage area 
15 112 contains, in TIFF format, photographic information 
relating to photographic parameters when the JPEG im- 
age was taken (e.g. date, exposure, shutter speed, etc.), 
and thumbnail image data for JPEG images stored in 
JPEG image data storage area 101. When image data 
20 is written to the memory card MC, this extra information 
is automatically stored in the extra data storage area 
102. The extra data storage area 102 is also provided 
with a Makernote data storage area 103, an undefined 
area currently left available for use by DSC manufactur- 
es ers. The Makernote data storage area 1 03 can be used 
by DSC manufacturers to store any desired information. 
It is common knowledge to practitioners of the art that 
the Exif format uses tags to identify data of various 
kinds. 

30 [0055] The Makernote data storage area 1 03 is also 
provided with an arrangement whereby stored data can 
be identified by way of tags. In the present embodiment 
there is stored image processing control information, Gl, 
for control of image processing in color printer 20. The 

35 image processing control information may be set by a 
DSC manufacturer through a trial and error process of 
matching the operational characteristics associated 
with a particular model of DSC, with the operational 
characteristics of a particular model of printer. This com- 

40 bination of characteristics, embodied in the parameters, 
ensures that an image output by a printer will be faithful 
to the image intended to be captured by the photogra- 
pher. 

[0056] Image processing control information Gl con- 
45 sists of information designating image output parame- 
ters for producing optimal output results with reference 
to the color reproduction capabilities and image output 
capabilities of color printer 20 or other output device. 
Information stored as image processing control informa- 
50 tion Gl includes parameters relating to gamma values 
and to the target color space, and parameters relating 
whether negative values are used and to contrast, color 
balance adjustment, sharpness, and color correction. Of 
these, parameters relating to gamma values, color 
55 space, and whether negative values are used represent 
information whose principal purpose is faithful reproduc- 
tion of the color characteristics of a subject, while the 
other parameters represent information whose principal 
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purpose is to produce the desired color reproduction. 
Negative values are color values that exceed the gamut 
of a specific RGB color space (in the present embodi- 
ment, the sRGB color space), and refer specifically to 
negative values and positive values exceeding 256. A 
more detailed description of negative values is provided 
later. 

[0057] An image file GF generated by digital still cam- 
era 12 is sent to a color printer 20 via a cable CV (or 
wireless channel) and a computer PC, or simply via a 
cable CV (or wireless channel). Alternatively, image files 
may be sent to color printer 20 via a computer PC con- 
nected to a memory card MC installed in digital still cam- 
era 12, or by directly connecting memory card MC to 
printer 20. The following description assumes direction 
connection of memory card MC to color printer 20. Once 
again, as an alternative to the wired connections, wire- 
less communications may be used as well for transfer- 
ring the image data file, including the image data and 
control information stored in the Makernote portion of 
the Exif 

B. Arrangement of image output device 

[0058] The following description of the general ar- 
rangement of the image output device pertaining to the 
first embodiment, namely, color printer 20, makes refer- 
ence to Fig. 4. Fig. 4 is a block diagram showing the 
general arrangementof components internal to the color 
printer 20 pertaining to the first embodiment. 
[0059] Color printer 20 is capable of color image out- 
put, for example, an ink-jet printer that forms images by 
jetting inks of four colors -for example, cyan (C), ma- 
genta (M), yellow (Y) and black (K)~ onto a print medium 
to produce a dot pattern. An electrophotographic printer 
that produces images by transferring and fixing color 
toner onto a print medium. Besides the four colors listed 
above, light cyan (LC), light magenta (LM), or dark yel- 
low (DY) may also be used. 

[0060] As shown in Figure 4, color printer 20 includes 
a mechanism for driving a print head 211 conveyed on 
a carriage 21 as it projects ink to produce dots; a mech- 
anism for producing, by way of a carriage motor 22, re- 
ciprocating motion of carriage 21 in the axial direction 
of a platen 23; a mechanism for advancing the printer 
paper P by way of a paper feed motor 24; and a control 
circuit 30. The mechanism for producing reciprocal mo- 
tion of carriage 21 in the axial direction of platen 23 in- 
cludes a slide rail 25 extending parallel to the axis of 
platen 23, for slidably retaining cartridge 21 ; a pulley 27 
having an endless drive belt 26 operating between it and 
carriage motor 22; and a position sensor 28 for sensing 
the home position of carriage 21. The mechanism for 
advancing printer paper P includes a platen 23; a paper 
feed motor 24 for turning platen 23; an auxiliary paper 
feed roller (not shown), and a gear train (not shown) for 
transmitting the rotation of paper feed motor 24 to platen 
23 and the auxiliary paper feed roller. 



[0061] Control circuit 30 exchanges signals with the 
control panel 29 of the printer for optimal control of the 
operation of paper feed motor 24, carriage motor 22, 
and print head 211. Printer paper P supplied to color 
5 printer 20 is arranged so as to be drawn between platen 
23 and the auxiliary paper feed roller, and is advanced 
in predetermined increments depending on the angle of 
rotation of platen 23. 

[0062] An ink cartridge 212 and ink cartridge 213 are 

10 installed on carriage 21 . Ink cartridge 21 2 contains black 
(K) ink, while ink cartridge 213 contains other inks, spe- 
cifically, inks of the three colors, cyan (C), magenta (M), 
yellow (Y), plus light cyan (LC), light magenta (LM), or 
dark yellow (DY), for a total of six color inks. 

15 [0063] The internal arrangement of control circuit 30 
of color printer 20 is now described with reference to 
Fig. 5. Fig. 5 is an illustrative diagram showing the in- 
ternal arrangement of control circuit 30 of color printer 
20. As shown in the drawing, control circuit 30 includes 

20 a CPU 31, PROM 32, RAM 33, a PCMCIA slot 34 for 
data interface with a memory card MC, a peripheral I/O 
portion (PIO) 35 for data interface with paper feed motor 
24, carriage motor 22 etc., a timer 36, a drive buffer 37 
etc. An I/O controller 3100 also connects to the other 

25 components via the PIO 35. The I/O controller 3100 is 
configured to exchange digital data (such as an Exif file) 
with external devices. The I/O controller 3100 operates 
with both wired and wireless I/O devices. Drive buffer 
37 is used as a buffer for supplying dot ON/OFF signals 

30 to ink jet heads 214-220, These are interconnected by 
way of a bus 38 to enable data interface between them. 
Control circuit 30 additionally includes an oscillator 39 
for outputting a drive waveform at a predetermined fre- 
quency, and a distributed output element 40 for distrib- 

35 uting the output of oscillator 39 to ink jet heads 21 4 -220 
under a predetermined timing arrangement. 
[0064] Control circuit 30 reads out an image file GF 
from memory card MC, analyzes the image processing 
control information Gl, and performs image processing 

40 on the basis of the analyzed image processing control 
information Gl. Control circuit 30 outputs dot data to 
drive buffer 37 under a predetermined timing arrange- 
ment synchronized with operation of the paper feed mo- 
tor 24 and carriage motor 22. The specifics of the image 

45 processing performed by control circuit 30 are dis- 
cussed later. 

C. Image processing in image output device 

50 [0065] Image processing in the color printer 20 per- 
taining to the first embodiment is now described with ref- 
erence to Figs. 6 and 7. Fig. 6 is a flow chart showing 
the processing routine for the printing process of color 
printer 20 pertaining to the first embodiment. Fig. 7 is a 
55 flow chart showing the flow of image processing in color 
printer 20. 

[0066] When a memory card MC is inserted in slot 34, 
(or alternatively an Exif file is received through I/O con- 
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trailer 31 00) the control circuit 30 (CPU 31 ) of printer 20 
reads out an image file GF from memory card MC, and 
temporarily places the image file GF in RAM 33 (STEP 
S100). From the extra data storage area 102 of image 
file GF CPU 31 searches for a PrintMatching tag indi- 
cating image processing control information for use dur- 
ing image processing of the image data (STEP S110). 
If CPU 31 has successfully retrieved the PrintMatching 
tag (STEP S120: Yes), it acquires and analyzes color 
space information for use during image processing 
(STEP S130). CPU 31 then executes image processing 
on the basis of the analyzed color space information, 
that is the whether the negative color values to be used 
(described in detail later) (STEP S140) and prints out 
the processed image data (STEP S150). 
[0067] If CPU 31 has not successfully retrieved a 
PrintMatching tag (STEP S120: No), it acquires from 
ROM 32 default color space information stored in color 
printer 20, for example, sRGB color space information, 
and executes image processing in the usual manner 
(STEP S1 60). CPU 31 then prints out the processed im- 
age data (STEP 150) and terminates the main process- 
ing routine. 

[0068] Image processing in color printer 20 is now de- 
scribed in greater detail with reference to Fig. 7. The 
control circuit 30 (CPU 31) of color printer 20 extracts 
image data GD from image file GF (STEP S200). As not- 
ed, digital still camera 12 stores image data as JPEG 
format files; to increase the compression ratio, image 
data in JPEG files is converted from the color space of 
the generated data (the sRGB color space) into a YCbCr 
color space for storage. 

[0069] However, as personal computers, printers and 
other devices typically handle only image data repre- 
sented in an RGB color space, image data represented 
in an YCbCr color space must be converted to an RGB 
color space. 

[0070] CPU 31 performs a 3 x 3 matrix operation S to 
convert YCbCr image data to RGB image data (STEP 
S21 0). Matrix operation S is an operation defined in the 
JPEG File Interchange Format (JFIF) specification for 
converting image data color space from a YCbCr color 
space to an RGB color space, and is given by the equa- 
tion illustrated in Figure 13. 

[0071] When performing matrix operation S, the con- 
verted RGB color space image data may in some in- 
stances include second positive color values that are out 
of gamut with respect to first positive color values rep- 
resenting the gamut of a specific RGB color space (e.g. 
the sRGB color space), or include negative color values 
that assume negative values in the RGB color space. In 
the present embodiment, image processing control in- 
formation Gl indicates whether such second positive 
color values or negative color values are used. Here, 
the sRGB color space is defined as the standard color 
space of the monitor, as is typical in operating systems 
(OS) which assume image data output on a monitor. 
RGB components for the gamut of the sRGB color 



space are assigned 8-bit data capacity. Thus, in conven- 
tional practice color values exceeding the gamut of the 
sRGB color space are "clipped," i.e. rounded, to within 
the gamut of the sRGB color space. 
5 [0072] While digital camera 1 2 is typically considered 
to use the sRGB color space, the definition of the sRGB 
color space may not be followed strictly. Accordingly, 
when the color space of image data GD is converted by 
way of matrix operation S to the RGB color space used 
by digital camera 12, there may be values that exceed 
the gamut of the sRGB color space. 
[0073] In the present embodiment, when use of the 
negative color values is designated by the image 
processing control information, image processing is per- 
formed without rounding of values that exceed the gam- 
ut of the sRGB color space. Where RGB color space 
image data resulting from a conversion includes second 
positive color values or negative color values, CPU 31 
allows these second positive color values and negative 
color values, without clipping (i.e., rounding) them to the 
gamut of the sRGB color space, and stores these to- 
gether with the first positive color values. Accordingly, if 
image data GD contains second positive color values or 
negative color values, image data GD is represented in 
an RGB color space (namely, the RGB color space used 
by digital still camera 1 2) having a wider gamut than the 
sRGB color space. Since image data GD includes color 
values outside the gamut of the sRGB color space gam- 
ut, data capacity will exceed 8 bits. 
[0074] Images in which negative values are allowed 
are described with reference to Fig. 8. Fig. 8 is an illus- 
trative diagram showing a two-dimensional representa- 
tion of color space gamuts, illustrating the significance 
of allowing image data values in an extended area (EA) 
outside the gamut of the sRGB color space. In the proc- 
ess of allowing negative values in the present embodi- 
ment, image data possesses not only RGB color space 
in-gamut data values, but also data values in an extend- 
ed area (EA) outside the gamut of the RGB color space, 
shown in Fig. 8. In the example in Fig. 8, extended area 
image data generated in the NTSC RGB color space is 
shown; however, the color space for image data gener- 
ation is not limited thereto. When the R, G and B com- 
ponents are plotted on coordinate axes, the RGB color 
space gamut is represented by coordinates (R, G, B); 
the case of image data including second positive color 
values and negative color values herein refers to a case 
wherein any one or more of the (R, G, B) components 
assumes second positive color values and negative 
color values. 

[0075] In the sRGB color space, image data is repre- 
sented in 256 gradations (8-bit) for each of the R, G and 
B components. Thus, the range for first positive color 
values are typically represented by integers 0 -255. The 
second positive color value range is represented by in- 
tegers of 256 and higher, and the negative value range 
by integers of -1 and smaller. 

[0076] Inclusion of second positive color values and 
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negative color values in addition to first positive color 
values in converted RGB color space image data --as 
contrasted with the sRGB color space-- refers to the use 
of a color space wider than the sRGB color space by the 
digital still camera 12 when generating image data, as 
described previously in reference to Fig. 8, for example. 
As noted, the sRGB color space has color space char- 
acteristics optimized for the color characteristics of CRT 
displays, and it is known that [sRGB] is typically incapa- 
ble of adequately representing color spaces used for 
photography by digital still cameras 1 2 or for printing by 
printers. 

[0077] Accordingly, while such second positive color 
values and negative color values cannot be represented 
in the sRGB color space, they can in some instances be 
represented by further transformation to an RGB color 
space having a wider gamut than the sRGBcolorspace, 
or to an RGB color space whose gamut can accommo- 
date the second positive color values and/or negative 
color values. Accordingly, the color printer 20 herein al- 
lows and keeps all information in image data that has 
been converted from a YCbCr color space to an RGB 
color space, including any second positive color values 
and negative color values. Of course, in the event that 
data values outside the gamut of the sRGB color space 
have been rounded during generation of image data by 
a digital camera 1 2, not even matrix operation S will give 
second positive color values and negative color values. 
[0078] CPU 31 performs gamma correction and a ma- 
trix operation M on the RGB color space image data ob- 
tained in the preceding manner (STEP S220). Here, 
processing is performed in accordance with color space 
information in the image processing control information 
Gl. During gamma correction, CPU 31 refers to the gam- 
ma value included in the parameters described earlier, 
and uses the set gamma value (native DSC value) for 
gamma conversion of image data. 
[0079] During gamma correction, where image 
processing control information Gl specifies the use of 
negative values, in the range in which the image data 
assumes first and second color values, as shown in Fig. 
9 CPU 31 uses a first gamma correction value y1 (set 
gamma value), and in the range in which the image data 
assumes negative values it uses a second gamma cor- 
rection value 72 smaller than the a first gamma correc- 
tion value y1 . The second gamma correction value y2 is 
further divided into a R component y2r, a G component 
y2g, and a B component y2b. Fig. 9 is an illustrative di- 
agram showing an exemplary first gamma curve L1 cor- 
responding to first gamma correction values y1 and sec- 
ond gamma curves L2r, L2g and L2b corresponding to 
second gamma correction values y2r, y2g, y2b for use 
in gamma correction. To facilitate the description, with 
the exception of second gamma curve L2, a represent- 
ative R component is taken as an example. First gamma 
curve L1 , as regards the R component, is expressed as 
Rt' = (Rt)f 1 , and second gamma curve L2 is expressed 
as Rt' = -(-Rt)T2r. 



[0080] Typically, the YCbCr color space and RGB 
color space are associated by way of the following equa- 
tion using a matrix operation S, and thus where image 
data represented in the YCbCr color space color system 

5 (0- Y~ 255, -128 ~ Cb -127, -128- Cr - 127) is repre- 
sented in the RGB color space color system, the R, G 
and B components positive color value range T is guar- 
anteed to have the range 0 -255, while the negative 
color value range T/2, which has no predefined repre- 

10 sentation, tends to be narrower than the positive color 
value range T. Thus, if the same gamma correction val- 
ue y1 used for positive color values were used as the 
gamma correction value for negative color values, the 
negative color value range R'1 subsequent to gamma 

15 correction will inevitably be smaller than the negative 
color value range R1 prior to gamma correction, as 
shown in Fig. 9, which does not allow effective use of 
the negative color values that one has deliberately set 
about to utilize. Under such conditions, by using a dif- 

20 ferent, second gamma correction value y2 (1 .5. for ex- 
ample) smaller than the first gamma correction value y1 
(2.2 for example) for positive color values as the gamma 
correction value y for negative color values in order to 
maintain in the XYZ color space a wide color space giv- 

25 en by negative color values for the R, G and B compo- 
nents, the gamma-converted (compensated) ranges 
Rt', Ct' and Bt' can be expanded. 
[0081] That is, when a photographic image is taken, 
by using a different gamma correction value -smaller 

30 than that for positive color values- as the gamma cor- 
rection value for negative color values, and using these 
respective gamma correction values during output of the 
image data as well, it becomes possible to represent im- 
age data in a wider range, thereby improving saturation 

35 in output image data and reproducing the actual vivid 
colors of the subject. 

[0082] Where gamma correction value y > 1.0, the 
slope at the origin is 0, and the first gamma curve L1 
and second gamma curve L2r connect smoothly at the 

40 joint (origin). As a result, there is afforded image data 
(image output) having smooth gradation change free 
from gradation jumps resulting from the joint of the first 
gamma curve L1 and second gamma curve L2r. 
[0083] Since the R, G and B components can assume 

45 different negative color value ranges, second gamma 
correction values y2 may be varied depending on the 
size of the color value range of the RGB components. 
As will be apparent from Fig. 10, discussed later, if the 
negative color value ranges expand to larger size in the 

50 order R component > B component > G component, for 
example, then second gamma correction values y2 may 
be increased in the order R component second gamma 
correction value y2r < B component second gamma cor- 
rection value y2b > G component second gamma cor- 

55 rection value y2g, as shown in Fig. 9. In this case, by 
performing appropriate gamma correction within ex- 
pandable color value ranges, the negative color values 
ranges can be utilized effectively. As a result, image da- 
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ta can be represented in a wider range, improving the 
saturation of output image data. 
[0084] Matrix operation M is an operation for convert- 
ing an RGB color space to an XYZ color space. When 
performing matrix operation M, to reflect the color space 
at image data generation, CPU 31 refers to a Color 
Space tag, and performs the matrix operation using the 
matrix (M) that corresponds to the color space indicated 
thereby. The sRGB color space or NTSC color space 
may be used at this time. The reason for reflecting color 
space information indicated in the Color Space tag via 
the XYZ color space is that the XYZ color space is an 
absolute color space, and is moreover device-inde- 
pendent, not being dependent on a particular device 
such as a DSC or printer. By making it such that during 
color space interchange as well, the same values are 
always assumed at XYZ color space level, color match- 
ing can be accomplished in a device-independent man- 
ner. Matrix operation M is given by the equation shown 
in Figure 14. 

[0085] The color space gamuts for the visible range 
(VA), sRGB (SR), NTSC (NS) and wRGB (WR) in the 
RGB color space are shown in Fig. 1 0. As will be appar- 
ent from Fig. 1 0, the sRGB color space has the narrow- 
est gamut, with the NTSC color space and wRGB color 
space having gamuts exceeding that of the sRGB color 
space. 

[0086] The color space of the image data GD derived 
from matrix operation M is the XYZ color space. In con- 
ventional practice, sRGB is the default color space for 
image processing in printers and computers, so the na- 
tive color space of digital still camera 12 cannot be uti- 
lized to full advantage. In the present embodiment, on 
the other hand, the color space used for generation of 
image data is specified as a target color space in the 
image processing control information Gl in the image file 
GF, and the printer (printer driver) modifies the matrix 
(M) for matrix operation M in response to the specified 
color space. Accordingly, even if digital still camera 12 
generates image data in the NTSC color space -whose 
RGB color space color characteristic is 1 and which has 
a wider [color] space than the sRGB color space-- the 
color space used for generating the image data can 
nonetheless be utilized effectively, so as to achieve ac- 
curate color reproduction. 

[0087] In order to perform image adjustment based on 
arbitrary information, CPU 31 converts the image data 
GD from the XYZ to the wRGB color space, i.e., it per- 
forms a matrix operation N~ 1 and inverse gamma cor- 
rection (STEP S230). As shown in Fig. 10, the wRGB 
color space is wider than the sRGB color space, so even 
second positive color values and negative color values 
that are out of gamut of the sRGB color space and can- 
not be represented can be allowed as reproducible color 
values lying within the gamut of the wRGB color space. 
During inverse gamma correction CPU 31 refers to color 
printer 20 gamma values included in the parameters de- 
scribed earlier, and performs inverse gamma conver- 



sion on the image data using the inverses of the set 
gamma values. When performing matrix operation N _1 
CPU 31 uses a matrix (N~ 1 ) -corresponding to conver- 
sion to the wRGB color space- from ROM 31 to perform 
5 the matrix operation. 

Matrix operation N -1 is given by the equation shown in 
Figure 15. 

[0088] The color space of the image data GD derived 
from matrix operation N _1 is the wRGB color space. As 

10 noted, this wRGB color space is wider than the sRGB 
color space, and corresponds to the RGB color space 
representable by digital still camera 12. 
[0089] CPU 31 performs automatic image adjustment 
to impart features to the image (STEP S240). Here, 

15 processing is performed in accordance with information 
relating to image quality contained in the image process- 
ing control information Gl. During automatic image ad- 
justment CPU 31 refers to the aforementioned parame- 
ters -specifically the parameter values brightness, 

20 sharpness etc., and performs image adjustment on the 
image data using set parameter values. Where auto- 
matic adjustment parameters are specified, other arbi- 
trarily established parameters may be reflected based 
on parameter values specified by automatic adjustment 

25 parameters. 

[0090] Even where these image quality adjustment 
parameters are not specified in the image processing 
control information Gl of an image file GF, since auto- 
matic image adjustment parameters are automatically 

30 appended by the digital still camera 12, CPU 31 per- 
forms image quality adjustment according to these au- 
tomatic adjustment parameters. 

[0091] CPU 31 performs wRGB color conversion and 
halftone processing for printing (STEP S250). In wRGB 

35 color conversion processing, CPU 31 refers to a lookup 
table (LUT) for CMYK color space conversion, associ- 
ated with the wRGB color space and stored in ROM 32, 
and converts the image data from the wRGB color space 
to the CMYK color space. Specifically, image data con- 

40 sisting of R ■ G ■ B grayscale values is converted, for 
example, to grayscale data for each of six colors C ■ M 
■ Y ■ K ■ LC ■ LM. 

[0092] In halftone processing, the color-converted im- 
age data is subjected to grayscaling. In the present em- 

45 bodiment, color-converted data is represented as data 
having 256 shades for each color. In contrast, the color 
printer 20 in the embodiment can only assume one of 
two states: "print a dot" or "do not print a dot". That is, 
the printer 20 herein can only produce two shades in a 

50 given location. Thus, 256-shade image data is convert- 
ed into image datathat the color printer 20 can represent 
using two shades. Representative methods for two- 
shade conversion (binarization) are the error diffusion 
technique and the systematic dithering technique. 

55 [0093] In color printer 20, if, prior to color conversion, 
the resolution of image data is lower than the print res- 
olution, new data lying between adjacent image data is 
generated by way of linear interpolation; if, conversely, 
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it is higher than the print resolution, a resolution conver- 
sion process wherein data is divided by a certain ratio 
to convert the image data resolution to the print resolu- 
tion is performed. Color printer 20 subjects image data 
converted to dot print/not print format to an interlacing 
process wherein the data is rearranged in the sequence 
in which it will be sent to the color printer 20. 
[0094] In the present embodiment, all image process- 
ing is performed in the color printer 20, and adot pattern 
is produced on a print medium according to the image 
data generated thereby. However, all or a portion of the 
image processing can be performed by the computer 
PC. This can be achieved by providing an image data 
processing application installed on the hard disk etc. of 
the computer PC with an image processing function, de- 
scribed with reference to Fig. 7. An image file GF gen- 
erated by digital still camera 12 is supplied to computer 
PC via a cable CV or via a memory card MC. The appli- 
cation is run on the PC under user control, whereupon 
the application reads the image file GF, analyzes the im- 
age processing control information Gl, and converts and 
adjusts the image data GD. Alternatively, the application 
can be designed to run automatically when detecting in- 
sertion of a memory card MC or detecting attachment 
of a cable CV, or reception of a wireless print command 
signal, whereupon the application reads the image file 
GF, analyzes the image processing control information 
Gl, and converts and adjusts the image data GD auto- 
matically. 

[0095] By way of image processing by color printer 20 
in accordance with to the first embodiment described 
hereinabove, second positive color values and negative 
color values generated during conversion of image data 
from a YCbCr color space to an RGB color space are 
allowed and can be utilized in image processing. Color 
printer 20 is provided with a CMYK color space conver- 
sion table associated with the wRGB color space, which 
is wider than the sRGB color space. Accordingly, color 
values, generated by a digital still camera 12, that lie 
outside the gamut of the sRGB color space are allowed, 
and color values outside the sRGB color space gamut 
can be utilized to achieve print output with higher satu- 
ration. That is, color values that exceed the gamut of the 
sRGB color space and cannot be represented thereby 
can be utilized to achieve print output with higher satu- 
ration. 

[0096] Image processing by color printer 20 can be 
performed so as to reflect color space information de- 
scribed by the ColorSpace tag in the image processing 
control information Gl of image file GF. Accordingly, im- 
age processing can be performed in accordance with 
color space characteristics specified by the digital still 
camera 12, and differences between photographed im- 
ages and color printer 20 output due to differences in 
color spaces [used by the devices] can be eliminated. 
The color reproduction capabilities of the digital still 
camera 12 can be reproduced correctly. 



D. Other Embodiments 

[0097] Image processing in color printer 20 may also 
be performed in the manner shown in Fig. 11 . Fig. 11 is 

5 a flow chart depicting image processing in a color printer 
20 as asecond embodiment. In this embodiment, during 
conversion of color space characteristics from the sRGB 
color space to the wRGB color space, image processing 
is accelerated by making matrix operation M and matrix 

10 operation N -1 into a single matrix operation (MN _1 ) 
(STEP S320). 

[0098] Image processing in a color printer 20 may also 
be performed as indicated in Fig. 12. Fig. 12 is a flow 
chart depicting image processing in a color printer 20 as 

15 a third embodiment. In this embodiment, automatic im- 
age adjustment of image data not represented in the 
YCbCr color space is performed first (STEP 41 0). Next, 
image data on which automatic image adjustment has 
been completed is subjected to sequential color space 

20 conversions by way of a matrix S operation (STEP 
S420), a matrix M operation (STEP S430), and a matrix 
N" 1 operation (STEP S440). 

[0099] In the above embodiments, image processing 
is performed in the color printer 20, and image process- 
es jng with second positive color values and negative color 
values is performed when use of negative values is des- 
ignated in the image process control information Gl. In 
a fourth embodiment, image processing is performed in 
a personal computer PC, and image processing with 
30 second positive color values and negative color values 
is performed when use of negative values is instructed 
by an operator via input devices. The image processing 
performed in the personal computer PC will be de- 
scribed with Fig. 1 6. Fig. 1 6 is a flow chart depicting im- 
35 age processing in a personal computer in accordance 
with the fourth embodiment. 

[0100] When a read out of the image file is instructed 
by the operator, the personal computer PC reads out an 
image file GF from memory card MC, and temporarily 

40 places the image file GF in RAM 33 (STEP S500). The 
personal computer PC determines whether the use of 
negative values is instructed by the operator (STEP 
S510). If personal computer determined an instruction 
for the use of negative values is instructed (STEP S51 0: 

45 Yes), the personal computer performs image processing 
with negative values and the second positive values 
contained in the image data GD (STEP S520), then ter- 
minates this processing routine. 

[0101] If personal computer PC determines the in- 
50 struction for the use of negative values is not instructed 
(STEP S510: No), the personal computer PC performs 
image processing without the negative values and the 
second positive values contained in the image data GD 
(STEP S530), then terminates this processing routine. 
55 According to this fourth embodiment, since the operator 
designates whether the negative values is used in im- 
age processing, image processing with negative values 
can be applied to the image file GF without PrintMatch- 
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ing tag (image processing control information Gl). Con- 
sequently, saturation in the image data is improved 
when the image file GF does not have the image 
processing control information Gl or the image data is 
not related to the image processing control information 
Gl. 

[0102] While all of the preceding embodiments of im- 
age processing employ a color printer 20 as the output 
device, a display device such as a CRT, LCD, projector 
etc. could also be used as the output device. In this case, 
depending on the display device used as the output de- 
vice, an image processing program (display driver) for 
executing the image processing described in Fig. 7, for 
example, could be used. Where the CRT, etc., functions 
as a display device for a computer, the image process- 
ing program can be run on the computer. In this case 
the final output image data will have an RGB color 
space, not a CMYK color space. 
[0103] Thus, in a manner analogous to reflecting in 
the print output of color printer 20 the color space of im- 
age data generated by digital still camera 12, it is pos- 
sible to specify in an image file GF the display on a CRT 
or other display device. Thus, by including in the image 
processing control information Gl of image file GF pa- 
rameters adapted to a display device such as a CRT, or 
by including parameters optimized for the display char- 
acteristics of an individual display device, image data 
GD generated by a digital still camera 12 can be cor- 
rectly displayed. 

[0104] In the first embodiment, the image processing 
control information Gl is stored in the image file along 
with the image data, the image processing control infor- 
mation Gl and the image data may be stored separately 
in the memory card MC. 

[0105] In the above embodiments, when the image 
processing control information Gl instructs the use of 
negative data value, or when the use of negative data 
values is instructed by, for example the operator, the 
negative data values and the second positive data val- 
ues are used in the image processing. In addition to 
these cases, the image processing may be performed 
with the negative data values and/or the second positive 
data values without any instructions or designates. That 
is, the image processing apparatus may perform the im- 
age processing with the negative data values and/or the 
second positive data values as an initial setting. With 
this arrangement, if the image data includes the nega- 
tive data values and/or the second positive data values, 
a result of the image processing reflects the negative 
data values and/or the second positive data values. Ac- 
cordingly, a high saturation image can be obtained. On 
the contrary, if the image data does not include the neg- 
ative data values and/or the second positive data val- 
ues, a usual image processing result is available. 
[0106] Although the image data output device of the 
invention has been shown and described with respect 
to certain preferred embodiments, these embodiments 
merely serve to facilitate understanding of the invention 



and should not be construed as limiting. It is obvious 
that equivalent alterations and modifications will occur 
to others skilled in the art without departing from the 
scope and spirit of the invention. 

5 [0107] For example, whereas in the first embodiment, 
a process to allow second positive color values and neg- 
ative color values during matrix S operation and a proc- 
ess to reflect specified color space information during 
matrix M operation are performed at the same time, but 

10 these processes need not be performed at the same 
time. For example, the color space used during matrix 
M operation could be set by default to the wRGB color 
space, performing only process to allow second positive 
color values and negative color values during matrix S 

15 operation. With this arrangement, colors that can be rep- 
resented by digital still camera 12 but not in the sRGB 
color space due to values outside the gamut of the 
sRGB color space can be represented, allowing output 
image saturation to be improved. 

20 [0108] Rather than using second positive color values 
and negative color values for processing during matrix 
S operation, processing could be made to reflect color 
space information when the image was taken, or spec- 
ified color space information during matrix M operation. 

25 With this arrangement, the color space used for gener- 
ating image data can be interpreted correctly during im- 
age processing so as to achieve correct color represen- 
tation. Thus, color space conversion can be performed 
in a device-independent manner, without affecting the 

30 native color space of the input device, output device, 
etc. As a result, output similar to the image data output 
obtained when a photographic image is taken can be 
obtained from the output device. 
[0109] Whereas, in the preceding embodiments, im- 

35 age processing control information Gl specifies if nega- 
tive values are used, image processing control informa- 
tion Gl may specify a gamma correction value for posi- 
tive values and a gamma correction value for negative 
values, without specifying if negative values are used. 

40 Negative values in image data GD mainly pose a prob- 
lem in gamma correction processing. Thus, by using dif- 
ferent gamma correction values for positive data and 
negative data during gamma correction, image process- 
ing can be performed without the need to specify if neg- 

45 ative values are used. 

[0110] Further, the parameters given hereinabove are 
merely exemplary and not intended as limiting of the in- 
vention. Similarly the matrix values in the matrices S, M 
and N _1 given by the equations are merely exemplary, 

50 and may be modified appropriately depending on the 
target color space, the color space used by the color 
printer 20, or other considerations. 
[0111] While the embodiments set forth herein de- 
scribe a digital still camera 12 as the image file gener- 

55 ating device, scanners, digital video cameras or the like 
may be used as well. Where a scanner is used, speci- 
fication of basic information and optional information for 
an image file GF may performed on a computer PC, or 
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performed with the scanner independently by providing 
the scanner with preset buttons having assigned thereto 
preset information for setting information, or with a dis- 
play screen and setting buttons for making optional set- 
tings. 

[0112] The color spaces employed in the embodi- 
ments set forth herein are merely exemplary, and other 
color spaces may be used. Image data generated by a 
digital still camera 12 or other image data generating 
device can be output so as to reflect the color space of 
the image data generating device. 
[0113] While the first embodiment herein describes 
an Exif format image file GF, the image file format herein 
is not limited thereto. It is possible to use any image file 
that includes at a minimum image data for output by an 
output device, and information pertaining to the color 
space used in a digital still camera 12 or other image 
data generating device. The use of such files minimizes 
differences in output image between image data gener- 
ated by another image data generating device (image 
display through the agency of a monitor etc.) and the 
image output by the output device. 
[0114] The color printer 20 of the first embodiment is 
merely exemplary, and the arrangement thereof is not 
limited to that shown in the embodiments herein. It suf- 
ficient for color printer 20 to have at a minimum the ability 
to analyze image processing control information Gl in 
an image file GF and to output (print) the image in ac- 
cordance with recorded or specified color space infor- 
mation. 

[0115] Image files GF that contain image data and im- 
age processing control information Gl include files cre- 
ated by generating association data associated with the 
image processing control information Gl and storing the 
image data and image processing control information 
Gl in separate files so as to enable the image data and 
image processing control information Gl to be associat- 
ed by referring to the association data during image 
processing. While in this case image data and image 
processing control information Gl are stored in separate 
files, during image processing using the image process- 
ing control information Gl, the image data and the image 
processing control information Gl are indivisibly united, 
so functionality is substantially the same as with storage 
in a single file. That is, the use of associated image data 
and image processing control information Gl -at least 
during image processing- is included in the definition of 
"image file GF" herein. Motion video files stored on op- 
tical media such as CD-ROM, CD-R, DVD-ROM and 
DVD-RAM are also included. 

[0116] In the preceding embodiments, a digital still 
camera is used to generate image files, but a digital vid- 
eo camera could be used as well. Files generated by 
digital video cameras take the form of image files con- 
taining static image data and output control information, 
or motion video files containing motion video data (e.g. 
in MPEG format) and output control information. Where 
motion video files are used, some or all of the frames of 



the video are subjected to output control with reference 
to the output control information. 
[0117] Obviously, numerous modifications and varia- 
tions of the present invention are possible in light of the 

5 above teachings. For example, features described for 
certain embodiments may be combined with other em- 
bodiments described herein. It is therefore to be under- 
stood that within the scope of the appended claims, the 
invention may be practiced otherwise than as specifical- 

10 |y described herein. 

Claims 

15 1. An image processing apparatus for performing im- 
age processing on image data, comprising: 

means for acquiring an image file that contains 
the image data and for acquiring use informa- 
20 tion associated with said image file, said use 

information being indicative of whether out of 
gamut information for a predetermined color 
space is to be used in performing image 
processing on the image data; 
25 means for analyzing the use information and 

deciding whether to use the out of gamut infor- 
mation for said predetermined color space; and 
means for performing image processing on 
said image data, including means for perform- 
30 ing color conversion of said out of gamut infor- 

mation to a wide gamut color space when the 
means for analyzing decides to use said out of 
gamut information, wherein a gamut of the wide 
gamut color space is sufficiently large to ac- 
35 commodate the image data associated with the 

out of gamut information. 

2. An image processing apparatus according to claim 
1 , wherein: 

40 

said means for performing color conversion 
performs image processing of 
said image data via a pre-established color 
space having a gamut equivalent to that of said 
45 predetermined color space when the means for 

analyzing decides not to use said out of gamut 
information. 

3. An image processing apparatus according to claim 
50 1, wherein: 

said image data contained in said image file is 
defined in a first color space; 
said means for acquiring includes means for 
55 converting the image data contained in the im- 

age file from said first color space to a second 
color space; and 

said means for performing color conversion 
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6. 



converts the image data in said second color 
space to a third color space using said out of 
gamut information. 

An image processing apparatus according to claim 5 
1 , wherein: 

said image data contained in said image file is 
produced to fall within a first color space and 
includes 10 

first positive color representation values 
that are color representation values lying 
within a gamut of said predetermined color 
space, 15 
second positive color representation val- 
ues, and 

negative color representation values that 
are color representation values lying out- 
side the gamut of said predetermined color 20 
space; and said means for acquiring in- 
cludes 

means for converting the color space 
of said image data from said first color 
space to a second color space by process- 25 
ing said negative color values and at least 
one of said first positive color representa- 
tion values and said second positive color 
representation values. 

30 

An image processing apparatus according to claim 

4, wherein: 

said means for performing image processing 
includes means for correcting gamma informa- 35 
tion in said image data using a first gamma cor- 
rection value when said image data contains 
said at least one of said first and said second 
positive color representation values, and using 
a second gamma correction value that is differ- 40 
ent from said first gamma correction value 
when said image data contains negative color 
representation values. 

An image processing apparatus according to claim 45 

5, wherein: said first color space is an RGB color 
space having a R component, a G component, and 
a B component; and 

said second gamma correction value includes 50 
different component values for each of said R 
component, said G component, and said B 
component. 



tained in the image file from said first color 
space to a second color space includes means 
for performing a first matrix operation on image 
data represented by said first color space, and 
said means for performing color conversion 
converts the image data in said second color 
space to a third color space includes means for 
performing a second matrix operation on image 
data represented by said second color space. 

An image processing apparatus for performing im- 
age processing on image data, comprising: 

means for acquiring an image file that contains 
the image data, said image data is represented 
in a first color space and includes 

first positive color representation values 
that are color representation values lying 
within a gamut of a predetermined color 
space, and 

at least one of second positive color repre- 
sentation values and negative color repre- 
sentation values that are color representa- 
tion values lying outside the color gamut of 
said predetermined color space; and 

means for performing color conversion of said 
image data using said first positive color repre- 
sentation values, and said at least one of said 
second positive color representation values 
and negative color representation values to 
convert said image data from said first color 
space to a second color space which is wider 
than said predetermined color space and has 
a color gamut that contains said at least one of 
said second positive color representation val- 
ues and said negative color representation val- 
ues. 

An image processing apparatus according to claim 
8, further comprising: 

means for performing gamma correction of said 
image data using 

a first gamma correction value where said 
image data contains said first and second 
positive color representation values, and 
a second gamma correction value different 
from said first gamma correction value 
where said image data contains negative 
color representation values. 



7. An image processing apparatus according to Claim 
3, wherein: 

said means for converting the image data con- 



55 10. A computer program product, comprising: 

a computer storage medium; and 

a computer program code mechanism embed- 
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ded in said computer storage medium for caus- 
ing a computer to process an image file from 
an image output device, said image file contain- 
ing image data and use information associated 
with the image data, the use information being 5 
indicative of whether out of gamut information 
for a predetermined color space is to be used 
in image processing of the image data, the 
computer program code mechanism having 

10 

a first computer code device configured to 
acquire said image file and the use infor- 
mation, 

a second computer code device configured 
to analyze the use information and decide 15 
whether to use color representation values 
lying outside the gamut of said predeter- 
mined color space in subsequent opera- 
tions where the image data is subjected to 
image processing, 20 
a third computer code device configured to 
perform image processing on the image 
data, and configured to perform color con- 
version of said out of gamut information to 
a wide color space that is sufficiently large 25 
to accommodate image data associated 
with the out of gamut information, and 
a fourth computer code device configured 
to output said image data after the third 
computer code device has performed the 30 
color conversion of the out of gamut infor- 
mation. 

1 1 . A computer program product according to claim 1 0, 
wherein: 35 

said image data contained in said image file is 
represented by a first color space and includes 

first positive color representation values 40 
that are color representation values lying 
within the gamut of said predetermined 
color space, and at least one of second 
positive color representation values and 
negative color representation values that 45 
are color representation values lying out- 
side the color gamut of said predetermined 
color space, wherein 

said second computer code device being con- 50 
figured to convert said image data from said 
first color space to said second color space us- 
ing said first positive color representation val- 
ues and at least one of said second positive 
color representation values and said negative 55 
color representation values. 

12. A computer program product according to claim 11 , 



30 
wherein: 

said third computer code device is configured 
to perform gamma correction on said image da- 
ta using 

a first gamma correction value where said 
image data contains said first positive color 
representation values, and 
a second gamma correction value different 
from said first gamma correction value 
where said image data contains negative 
color representation values. 

13. A device for generating an image file that contains 
image data and image processing control informa- 
tion for subsequent image processing of the image 
data, comprising: 

means for generating said image data; 
means for generating image processing control 
information, said image processing control in- 
formation including use information that is in- 
dicative of whether out of gamut information for 
a predetermined color space is to be used in 
performing image processing on said image 
data; and 

means for generating an image file that con- 
tains said image data and said image process- 
ing control information. 

14. A device for generating an image file according to 
claim 13, further comprising: 

means for conveying said image file to another 
device via at least one of a removable memory 
card, a wired communication link, and a wire- 
less communication link. 

15. A device for generating an image file according to 
claim 13, wherein: 

the means for generating the image data being 
at least one of a DSC, DVC and a scanning de- 
vice. 

16. A device for generating an image file according to 
claim 13, wherein: 

said means for generating the image file is con- 
figured to arrange said image file as an Exif file, 
and arrange said image processing control in- 
formation in a Makernote portion of the Exif file. 

17. A device for generating an image file that contains 
image data and image processing control informa- 
tion that is indicative of image processing conditions 
for subsequent processing of the image data, com- 
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prising: 

means for generating image data that includes 

first positive color representation values 5 
which are color representation values lying 
within a gamut of a predetermined color 
space, and 

at least one of second positive color repre- 
sentation values and negative color repre- 10 
sentation values that are color representa- 
tion values lying outside the gamut of said 
predetermined color space; and 

means for generating image processing control 15 
information that includes 

use information indicating whether at least 
one of said second positive color represen- 
tation values and negative color represen- 20 
tation values are part of the image data to 
be processed, 

a first gamma correction value for use with 
image data containing at least one of said 
first second positive color representation 25 
value and said second positive color rep- 
resentation value, and 
a second gamma correction value, differ- 
ent from said first gamma correction value, 
for use with image data that contains neg- 30 
ative color representation values. 

18. A device for generating an image file according to 
claim 17, wherein: 

35 

said image processing control information fur- 
ther includes color space conversion character- 
istics for performing color space conversion of 
said image data to a color space that is wider 
than said predetermined color space and that 40 
has a sufficiently wide gamut to include said at 
least one of said second color representation 
values and said negative color representation 
values. 

45 

19. A method for outputting an image file with image 
data represented by a first color space, comprising 
steps of: 

acquiring the image file that contains the image 50 
data and acquiring use information associated 
with said image file, said use information being 
indicative of whether out of gamut information 
for a predetermined color space is to be used 
in performing image processing on the image 55 
data; 

converting from a first color space to a second 
color space; 



analyzing the use information and deciding 
whether to use the out of gamut information for 
representing the image data in said predeter- 
mined color space; 

converting the image data from the second 
color space to a third color space when in said 
analyzing the use information step it is decided 
that said out of gamut information is to be used 
to convert the color space of image data repre- 
sented by said second color space to said third 
color space; and 

outputting said image data after the image data 
is converted into said third color space. 

20. A method according to Claim 19, wherein: 

said first color space is a YCbCr color space; 
said second color space is a first RGB color 
space; and 

said third color space is a second RGB color 
space having a gamut wider than said first RGB 
color space. 

21. A method according to Claim 20, wherein: 

said second color space is a sRGB color space. 

22. A method according to Claim 21, wherein: 

said first color space is a YCbCr color space; 
said second color space is a first RGB color 
space; and 

said third color space is a CIELAB color space. 

23. A method according to Claim 19, wherein: 

said image data contained in said image file is 
produced in a first color space and includes 

first positive color representation values 
that are color representation values lying 
within a gamut of said predetermined color 
space, 

second positive color representation val- 
ues, and 

negative color representation values that 
are color representation values lying out- 
side the gamut of said predetermined color 
space; and said acquiring step includes 
converting the color space of said image 
data from said first color space to a second 
color space by processing said negative 
color values and at least one of said first 
positive color representation values and 
said second positive color representation 
values. 

24. A method according to Claim 19, further compris- 
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correcting gamma information in said image 
data using a first gamma correction value when 
said image data contains said at least one of 
said first and second positive color representa- 
tion values, and using a second gamma correc- 
tion value that is different from said first gamma 
correction value when said image data contains 
negative color representation values. 

25. A method according to Claim 19, wherein: 

said second gamma correction value is smaller 
than said first gamma correction value. 

26. A method according to Claim 22, wherein: 

said first color space is an RGB color space 
having a R component, a G component, and a 
B component; and 

said second gamma correction value includes 
different component values for each of said R 
component, said G component, and said B 
component. 

27. A method according to Claim 19, further compris- 
ing: 

performing a first matrix operation on image da- 
ta represented by said first color space; and 
performing a second matrix operation on image 
data represented by said second color space. 

28. A method according to Claim 19, wherein: 

said outputting step includes printing onto a 
print medium said image data. 

29. A method for outputting image data, comprising 
steps of: 

acquiring said image data represented by a first 
color space; 

converting the image data from said first color 
space to a second color space; 
holding information about the image data that 
is contained in the second color space after the 
converting step, and holding information about 
the image data that falls outside a gamut of said 
second color space; 

converting the image data to a third color space 
using the information held about the image data 
that falls outside the gamut of the second color 
space; and 

outputting said image data after said converting 
step. 



30. A method for outputting image data according to 
claim 29, wherein: 

information about the image data contained in 
5 the gamut of said second color space is ex- 

pressed as first positive gamut values, and in- 
formation about the image data that falls out- 
side the gamut defining said second color 
space is expressed as second positive values 
10 that either exceed said first positive gamut val- 

ues or are negative gamut values. 

31. A method for outputting image data according to 
claim 30, further comprising: 

15 

performing gamma correction on said image 
data using 

a first gamma correction value where said 
20 image data contains said first positive gam- 

ut values, and 

a second gamma correction value different 
from said first gamma correction value 
where said image data contains negative 
25 gamut values. 

32. A method for processing image data, comprising 
steps of: 

30 acquiring image data represented by a first 

color space and converting the image data from 
said first color space to said second color 
space; 

holding information about the image data that 
35 is contained within a gamut of the second color 

space, and information about the image data 
that falls outside the gamut of said second color 
space; and 

converting the image data to a third color space 
40 using the information about the image data that 

falls outside the gamut of the second color 
space, wherein said third color space has a wid- 
er gamut than said second color space so the 
image data is fully represented in the third color 
45 space. 

33. An image processing apparatus for performing im- 
age processing on image data, comprising: 

50 an image file acquisition mechanism config- 

ured to acquire an image file that contains the 
image data and acquires use information asso- 
ciated with said image file, said use information 
being indicative of whether out of gamut infor- 
55 mation for a predetermined color space is to be 

used in performing image processing on the im- 
age data; 

a processor configured to analyze the use in- 
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formation and determine whether to use the out 
of gamut information for said predetermined 
color space; and 

an image processor configured to perform color 
conversion of said out of gamut information to 
a wide gamut color space when the processor 
decides to use said out of gamut information, 
wherein a gamut of the wide gamut color space 
is sufficiently large to accommodate the image 
data associated with the out of gamut informa- 
tion. 

34. An image processing apparatus according to claim 
33, wherein: 

said processor is configured to perform image 
processing of said image data via a pre-estab- 
lished color space having a gamut equivalent 
to that of said predetermined color space. 

35. An image processing apparatus according to claim 
33, wherein: 

said image data contained in said image file is 
defined in a first color space; 
said image file acquisition mechanism is con- 
figured to convert the image data contained in 
the image file from said first color space to a 
second color space; and 
said image processor is configured to convert 
the image data in said second color space to a 
third color space using said out of gamut infor- 
mation. 

36. An image processing apparatus according to claim 

35, wherein: 

said first color space is a YCbCr color space; 
said second color space is a first RGB color 
space; and 

said third color space is a second RGB color 
space having a gamut wider than said first RGB 
color space. 

37. An image processing apparatus according to claim 

36, wherein: 

said second color space is asRGB color space. 

38. An image processing apparatus according to claim 
35, wherein: 

said first color space is a YCbCr color space; 
said second color space is a first RGB color 
space; and 

said third color space is a CIELAB color space 
rather than a second RGB color space. 



39. An image processing apparatus according to claim 
33, wherein: 

said image data contained in said image file is 
5 produced to fall within a first color space and 

includes 

first positive color representation values 
that are color representation values lying 
within a gamut of said predetermined color 
space, 

second positive color representation val- 
ues, and 

negative color representation values that 
are color representation values lying out- 
side the gamut of said predetermined color 
space; and said image file acquisition 
mechanism includes 

a conversion mechanism configured to 
convert the color space of said image data 
from said first color space to a second color 
space by processing said negative color 
values and at least one of said first positive 
color representation values and said sec- 
ond positive color representation values. 

40. An image processing apparatus according to claim 

39, wherein: 

said image processor includes a mechanism 
for correcting gamma information in said image 
data using a first gamma correction value when 
said image data contains said at least one of 
said first and second positive color representa- 
tion values, and using a second gamma correc- 
tion value that is different from said first gamma 
correction value when said image data contains 
negative color representation values. 

41. An image processing apparatus according to claim 

40, wherein: 

said second gamma correction value is smaller 
than said first gamma correction value. 

42. An image processing apparatus according to claim 
39, wherein: 

said conversion mechanism is configured to 
convert said image data represented by said 
second color space and including said first pos- 
itive color representation values, said second 
positive color representation values and said 
negative color representation values to a third 
color space that is wider than said second color 
space and whose gamut includes at least one 
of said second positive color representation 
values and said negative color representation 
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values. 

43. An image processing apparatus according to claim 
40, wherein: 

said first color space is an RGB color space 
having a R component, a G component, and a 
B component, and 

said second gamma correction value includes 
different component values for each of said R 
component, said G component, and said B 
component. 

44. An image processing apparatus according to Claim 
35, wherein: 

said image file acquisition mechanism is con- 
figured to perform a first matrix operation on im- 
age data represented by said first color space; 
and 

said image processor is configured to perform 
a second matrix operation on image data rep- 
resented by said second color space. 

45. An image processing apparatus according to claim 
33, further comprising: 

a printer configured to print an image on a re- 
cording medium after the image data is proc- 
essed by said image processor. 

46. An image processing apparatus for performing im- 
age processing on image data, comprising: 



determined color space and has a color gamut 
that contains said at least one of said second 
positive color representation values and said 
negative color representation values. 

5 

47. An image processing apparatus according to claim 
46, further comprising: 

a gamma correction mechanism configured to 
10 perform gamma correction of said image data 

using 

a first gamma correction value where said 
image data contains said first and second 
15 positive color representation values, and 

a second gamma correction value different 
from said first gamma correction value 
where said image data contains negative 
color representation values. 

20 

48. An image processing apparatus according to claim 
46, further comprising: 

a printer configured to print an image on a print 
25 medium based on said image data, after said 

image data is processed by said image proces- 
sor. 

49. A device for generating an image file that contains 
30 image data and image processing control informa- 
tion for image processing of the image data, com- 
prising: 

a data acquisition mechanism configured to ar- 
range image data in the image file; 
a control information generation mechanism 
configured to generate process control infor- 
mation that includes use information that is in- 
dicative of whether out of gamut information for 
a predetermined color space is to be used in 
performing image processing on said image 
data; and 

an image file setting mechanism that arranges 
said image data generated by said data acqui- 
sition mechanism and said image processing 
control information generated by said control 
information generation mechanism into the im- 
age file in a predetermined file format. 

50. A device for generating an image file according to 
claim 49, wherein: 

said image data contained in said image file is 
defined by a first color space; and 
said use information is used in subsequent im- 
age processing of said image data to convert 
said image data from the first color space to a 
second color space, and then from the second 



an image file acquisition mechanism config- 35 
ured to acquire an image file that contains the 
image data, said image data is represented by 
a first color space and includes 

first positive color representation values 40 
that are color representation values lying 
within a gamut of a predetermined color 
space, and 

at least one of second positive color repre- 
sentation values and negative color repre- 45 
sentation values that are color representa- 
tion values lying outside the color gamut of 
said predetermined color space; and 

an image processor configured to perform color 50 
conversion of said image data using said first 
positive color representation values, and said 
at least one of said second positive color rep- 
resentation values and negative color repre- 
sentation values to convert said image data 55 
from said first color space to a second color 
space, wherein 

said second color space is wider than said pre- 
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color space to a third color space without using 
loosing color information originally contained in 
said image data when acquired by said data ac- 
quisition mechanism. 

5 

51. A device for generating an image file according to 
claim 50, wherein: 

said first color space is a YCbCr color space; 
said second color space is a first RGB color 10 
space; and 

said third color space is a second RGB color 
space having a gamut wider than said first RGB 
color space. 

15 

52. A device for generating an image file according to 
claim 51 , wherein: 

said second color space is asRGB color space. 

20 

53. A device for generating an image file according to 
claim 50, wherein: 



54. A device for generating an image file according to 
claim 49, wherein: 30 



55. A device for generating an image file according to 55 
claim 54, wherein: 

said process control information includes a first 



gamma correction value when said image data 
contains said at least one of said first and sec- 
ond positive color representation values, and a 
second gamma correction value that is different 
from said first gamma correction value when 
said image data contains negative color repre- 
sentation values. 

56. A device for generating an image file according to 
claim 55, wherein: 

said second gamma correction value is smaller 
than said first gamma correction value. 

57. A device for generating an image file according to 
claim 54, wherein: 

said conversion mechanism is configured to 
convert said image data represented by said 
second color space and including said first pos- 
itive color representation values, said second 
positive color representation values and said 
negative color representation values to a third 
color space that is wider than said second color 
space and whose gamut includes at least one 
of said second positive color representation 
values and said negative color representation 
values. 

58. A device for generating an image file according to 
claim 55, wherein: 

said first color space is an RGB color space 
having a R component, a G component, and a 
B component, and 

said second gamma correction value includes 
different component values for each of said R 
component, said G component, and said B 
component. 

59. A device for generating an image file according to 
claim 49, further comprising: 

a computer readable memory configured to 
hold the image file and control information. 

60. A device for generating an image file according to 
claim 49, wherein: 

said computer readable memory being a re- 
movable memory card. 

61. A device for generating an image file according to 
claim 49, further comprising: 

an output port coupled said computer readable 
memory and configured to convey said image 
file to another device via at least one of a wired 



said first color space is a YCbCr color space; 
said second color space is a first RGB color 25 
space; and 

said third color space is a CIELAB color space. 



said image data contained in said image file is 
produced to fall within a first color space and 
includes 

35 

first positive color representation values 
which are color representation values lying 
within a gamut of said predetermined color 
space, 

second positive color representation val- 40 
ues, and 

negative color representation values which 
are color representation values lying out- 
side the gamut of said predetermined color 
space; and said image file setting mecha- 45 
nism includes 

a conversion mechanism configured to 
convert the color space of said image data 
from said first color space to a second color 
space by processing said negative color 50 
values and at least one of said first positive 
color representation values and said sec- 
ond positive color representation values. 
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connection and a wireless communication link. 

62. A device for generating an image file according to 
claim 49, wherein: 

the data acquisition mechanism being at least 
one of a DSC, DVC and a scanning device. 

63. A device for generating an image file according to 
claim 49, wherein: 

said image file setting mechanism is configured 
to arrange said image file as an Exif file. 

64. A device for generating an image file according to 
claim 63, wherein: 

said image file setting mechanism is configured 
to arrange said image processing control infor- 
mation in a Makernote portion of the Exif file. 

65. A device for generating an image file that contains 
image data and image processing control informa- 
tion indicating image processing conditions for 
processing the image data, comprising: 

a data acquisition mechanism configured to ar- 
range image data in an image file, said image 
data includes 

first positive color representation values 
which are color representation values lying 
within a gamut of a predetermined color 
space, and 

at least one of second positive color repre- 
sentation values and negative color repre- 
sentation values that are color representa- 
tion values lying outside the gamut of said 
predetermined color space; and 

an image processing control information setting 
mechanism configured to set control informa- 
tion regarding a color space and gamma cor- 
rection values for said image data, said control 
information including 



for use with image data that contains neg- 
ative color representation values. 

66. A device for generating an image file according to 
5 claim 65, wherein: 

said image processing control information fur- 
ther includes color space conversion character- 
istics for performing color space conversion of 

10 said image data to a color space that is wider 

than said predetermined color space and that 
has a sufficiently wide gamut to include said at 
least one of said second color representation 
values and said negative color representation 

15 values. 

each of said R component, said G component, 
and said B component. 

67. A device for generating an image file according to 
20 claim 65, further comprising: 

a computer readable memory configured to 
hold the image file and control information. 

25 68. A device for generating an image file according to 
claim 67, wherein: 

said computer readable memory being a re- 
movable memory card. 

30 

69. A device for generating an image file according to 
claim 68, further comprising: 

an output port coupled said computer readable 
35 memory and configured to convey said image 

file to another device via at least one of a wired 
connection and a wireless communication link. 

70. A device for generating an image file according to 
40 claim 66, wherein: 

the data acquisition mechanism being at least 
one of a DSC, DVC and a scanning device. 

45 71. An image processing apparatus for performing im- 
age processing on image data, comprising: 

means for acquiring the image data, wherein 
the image data contains out of gamut informa- 
tion for a predetermined color space; 
means for instructing use of the out of gamut 
information for said predetermined color space; 
and 

means for performing image processing on 
said image data, wherein the image processing 
includes means for performing color conver- 
sion of said out of gamut information to a wide 
gamut color space when use of the out of gamut 



use information indicating whether at least 
one of said second positive color represen- 
tation values and negative color represen- 
tation values are part of the image data to 50 
be processed, 

a first gamma correction value for use with 
image data containing at least one of said 
first second positive color representation 
value and said second positive color rep- 55 
resentation value, and 
a second gamma correction value, differ- 
ent from said first gamma correction value, 
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information is instructed, wherein a gamut of 
the wide gamut color space is sufficiently large 
to accommodate the image data associated 
with the out of gamut information. 

5 

72. An image processing apparatus according to claim 
71 , wherein the means for performing color conver- 
sion performs image processing the image data via 
a pre-established color space having a gamut 
equivalent to that of the predetermined color space 10 
when use of the out of gamut information is not in- 
structed. 
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